SGR: A New Efficient Kernel for Outlier Detection in Sensor Data Minimizing Mise
نویسندگان
چکیده
In sensor network, collected data is error prone due to errors during sensors and transmission. Sometimes, the sensed data may appear to be erroneous due to large deviation from normal data distribution. Such data points termed as outliers may contain some important pattern. Outliers, if neglected as erroneous data, may result in failure to detect important phenomenon. Hence, it is necessary to not only detect such data points but analyze them further to establish the reason behind such data values. The presence of outliers may distort contained information. To ensure that the information is correctly extracted, it is necessary to identify the outliers and isolate them during knowledge extraction phase. In this paper, we propose a novel unsupervised algorithm for detecting outliers based on density by coupling two principles: first, kernel density estimation and second assigning an outlier score to each object. A new kernel function building a smoother version of density estimate is proposed. An outlier score is assigned to each object by comparing local density estimate of each object to its neighbors. The two steps provide a framework for outlier detection that can be easily applied to discover new or unusual types of outliers. Experiments performed on synthetic and real datasets suggest that the proposed approach can detect outliers precisely and achieve high recall rates which in turn demonstrate the potency of the proposed approach. Copyright © 2015 IFSA Publishing, S. L.
منابع مشابه
Outlier Detection in Wireless Sensor Networks Using Distributed Principal Component Analysis
Detecting anomalies is an important challenge for intrusion detection and fault diagnosis in wireless sensor networks (WSNs). To address the problem of outlier detection in wireless sensor networks, in this paper we present a PCA-based centralized approach and a DPCA-based distributed energy-efficient approach for detecting outliers in sensed data in a WSN. The outliers in sensed data can be ca...
متن کاملOutlier Detection for Support Vector Machine using Minimum Covariance Determinant Estimator
The purpose of this paper is to identify the effective points on the performance of one of the important algorithm of data mining namely support vector machine. The final classification decision has been made based on the small portion of data called support vectors. So, existence of the atypical observations in the aforementioned points, will result in deviation from the correct decision. Thus...
متن کاملAn Online Outlier Detection Technique for Wireless Sensor Networks
We propose an online and local outlier detection technique with low resource consumption based on an unsupervised centered quartersphere support vector machine for wireless sensor networks. Using synthetic data, we demonstrate that our technique achieves better mining performance in terms of parameter selection using difference kernel functions compared to an earlier offline outlier detection t...
متن کاملOutlier Detection Using Extreme Learning Machines Based on Quantum Fuzzy C-Means
One of the most important concerns of a data miner is always to have accurate and error-free data. Data that does not contain human errors and whose records are full and contain correct data. In this paper, a new learning model based on an extreme learning machine neural network is proposed for outlier detection. The function of neural networks depends on various parameters such as the structur...
متن کاملDistance Based Method for Outlier Detection of Body Sensor Networks
We propose a distance based method for the outlier detection of body sensor networks. Firstly, we use a Kernel Density Estimation (KDE) to calculate the probability of the distance to k nearest neighbors for diagnosed data. If the probability is less than a threshold, and the distance of this data to its left and right neighbors is greater than a pre-defined value, the diagnosed data is decided...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2015